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Abstract 

Common ground to recent studies exploiting relations between dynam- 
ical systems and non-equilibrium statistical mechanics is, so we argue, 
the standard Gibbs formalism applied on the level of space-time histories. 
The assumptions (chaoticity principle) underlying the Gallavotti-Cohen 
fluctuation theorem make it possible, using symbolic dynamics, to em- 
ploy the theory of one-dimensional lattice spin systems. The Kurchan 
and Lebowitz-Spohn analysis of this fluctuation theorem for stochastic 
dynamics can be restated on the level of the space-time measure which 
is a Gibbs measure for an interaction determined by the transition prob- 
abilities. In this note we understand the fluctuation theorem as a Gibbs 
property as it follows from the very definition of Gibbs state. We give 
a local version of the fluctuation theorem in the Gibbsian context and 
we derive from this a version also for some class of spatially extended 
stochastic dynamics. 

Keywords: fluctuation theorem, large deviations, nonequilibrium, Gibbs states. 

1 Context and main observations. 
1.1 Scope. 



The fluctuation theorem of Gallavotti and Cohen, see |10|, [llj, [26| , asserts that 
for a class of dynamical systems the fluctuations in time of the phase space con- 
traction rate obey a general law. We refer to the cited literature for additional 
details and precision and we only sketch here the main ingredients. 
One considers a reversible smooth dynamical system £ — > </>(£),£ <E f2. The 
phase space f2 is in some sense bounded carrying only a finite number of de- 
grees of freedom (a compact and connected manifold). The transformation (j) 
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is a diffeomorphism of il. The resulting (discrete) time evolution is obtained 
by iteration and the reversibility means that there is a diffeomorphism 9 on f2 
with 9 2 = 1 and 6 o (j> o 9 = dpr 1 . Consider now minus the logarithm of the 
Jacobian determinant J which arises from the change of variables implied by 
the dynamics. We write S = — log J. One is interested in the fluctuations of 

N/2 

W N (0 EE ^ 5(^(0), (1.1) 

-If/a 

for large time N. Here, p is the stationary probability measure (SRB measure) 
of the dynamics with expectations 
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corresponding to time-averages for almost every randomly chosen initial point 
£ G Q. This random choice refers to an absolutely continuous measure with 
respect to the Riemann volume element g?£ on Q (and is thought of as describing 
the microcanonical ensemble for £1 the energy surface). £(£) is the phase space 
contraction rate (which is identified with the entropy production rate) and one 
assumes (and sometimes proves) dissipativity: 

p(S) > 0. (1.3) 

It is assumed that the dynamical system satisfies some technical (ergodic) con- 
dition: it is a transitive Anosov system. This ensures that the system allows 
a Markov partition (and the representation via some symbolic dynamics) and 



the existence of the SRB measure p in (1.2). This technical assumption is not 



taken physically very serious but instead it is supposed to guide us towards 
general results which are true in a broader context^. That is what is affirmed 
in the so called chaotic hypothesis: "A reversible many particle system in a 
stationary state can be regarded as a transitive Anosov system for the purpose 
of computing the macroscopic properties," see also e.g. (k], [llj frj jij ^5, p|. 
The fluctuation theorem then states that wn(Q has a distribution pn(w) with 
respect to the stationary state p such that 

l im ^_l n ^M_ = 1 (1 . 4) 

always. In other words, the distribution of entropy production over long time 
intervals satisfies some general symmetry property. 

This theorem originated from numerical evidence, e.g. in ||, and it has various 
interesting consequences. For example, in JtJ, it was interpreted as extending the 
Green-Kubo formulas to arbitrary forcing fields for a class of non-equilibrium 
dynamics. 

In |l(|, Kurchan pointed out that this fluctuation theorem also holds for 
certain diffusion processes. This is the context of finite systems undergoing 

x The situation resembles here to some extent that for the ergodic hypothesis. Ergodicity 
is likely to be false in quite a number of realistic situations and in any event it is irrelevant. 
Nevertheless assuming ergodicity can lead to correct consequences. 
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Langevin dynamics. This was extended by Lebowitz and Spohn in fll9| to quite 
general Markov processes. There was however no general scheme for identifying 
the quantity (being some analogue of (1.1)) for which the fluctuation theorem 
holds. Yet, from applying the fluctuation theorem in this context to simple mod- 
els of stochastic dynamics, relations appeared between the entropy production 
and the action functional satisfying the theorem. 

In this note we understand the fluctuation theorem within the Gibbs formal- 
ism. Since this formalism is often considered as giving a mathematical struc- 
ture to the theory of equilibrium statistical mechanics and in order to avoid 
misunderstanding, we insist from the beginning that we wish to see this Gibbs 
formalism applied here to noncquilibrium conditions. The right way of looking 
at it, is to consider space-time histories drawn from a Gibbs measure. In other 
words, our analysis is not to be regarded as an investigation of fluctuations in 
an equilibrium system or as the restriction of the fluctuation theorem to equi- 
librium conditions. On the contrary, the observations we make can be seen as 
underlying and (at least in some sense) extending both the Gallavotti-Cohen 
and the Kurchan and Lebowitz-Spohn fluctuation theorems. Underlying be- 
cause the technical conditions of the Gallavotti-Cohen work reduce to a large 
extent the fluctuation theorem to a statement about one-dimensional Gibbs 
measures. That is not very different in the Lebowitz-Spohn work where the 
strong chaoticity is replaced by stochasticity and the Perron-Frobenius theorem 
is applied to the dynamical generator as it is usually done for the transfer ma- 
trix in one-dimensional Gibbs states. The fact that something more general and 
typical of Gibbs states is at work here was already announced in Section 3 of 
[|l] where Example 1.2 below was applied to the one-dimensional Ising model 
in an external field. Our work systematizes this remark. But for Gibbs states, 
the fluctuation theorem does not rely on having one dimension or on a high 
temperature condition. Once this is perceived, one is tempted to conclude that 
chaoticity assumptions, while important guides, cannot really be necessary for 
a fluctuation theorem or its consequences to hold. Perhaps it is more natural to 
assume immediately that for the purpose of computing macroscopic properties, 
a many particle system in a steady state should be regarded as a Gibbs system 
for the space-time histories. And we know that the reason for Gibbs distribu- 
tions has little to do with the detailed properties of the system's dynamics but 
instead is based on statistical principles []. There is finally a second, practically 
speaking, more important extension of the earlier results. In the analysis be- 
low, we present a local version of the fluctuation theorem. A mechanism for 
the validity of a local version was already discussed in the recent This is 
crucial because it is only a local fluctuation theorem that leads to observable 
consequences and we will see that this is quite natural in a Gibbsian setup. 



1.2 Disclaimers. 

Our analysis below is limited in various ways including: 

1. Time (and space) is discrete: a regular lattice plays the role of space-time. 

2 We have in mind the maximum entropy principle .an d the foundations of statistical me- 
chanics in the theory of large deviations, see e.g. f\ji Il4| . This must be contrasted with the 
approach from the theory of dynamical systems (as summarized for example in ]26|). Notice 
that Markov partitions do not correspond to a statistical procedure; they fully encode the 
dynamics. 
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We believe that going to continuous time is a technical step (which is not ex- 
pected to be very difficult) and that this is irrelevant for the purpose of the 
paper. 

2. No hard-core conditions: we take a smooth potential and all transition prob- 
abilities are bounded away from zero. In particular, this seems problematic 
when dealing with dynamics subject to certain conservation laws. Again, we do 
not think that this is essential because the Gibbs properties we use also hold for 
hard-core interactions. Extra care and conditions would be needed for writing 
down certain formulae but we believe they do not modify the main result. 

3. Discrete spins: we deal with regular lattice spin systems. While some com- 
pactness of phase space is nice to have around, our results depend solely on 
having a large deviation principle for Gibbs states. The extent to which such a 
principle holds decides on the possible extensions of our results. 

4. No phase transitions: while the fluctuation theorem holds quite generally, 
its contents can be empty when the large deviations happen on another scale 
than linear in time (and spatial volume). In other words, the corresponding 
rate function could fail to be strictly convex in which case instabilities or phase 
transitions are present. These 'violations' of the fluctuation theorem can of 
course not happen when the spatial volume is finite (for a sufficiently chaotic 
dynamics or for a non-degenerated stochastic dynamics) or, for infinite systems, 
when we are in the 'high temperature' regime. Such scenario's are of course 
well-documented for Gibbs states. 

5. Steady states and time- homogeneity: we do not consider here the (physically 
very relevant) problem of forces or potentials depending on time nor do we in- 
vestigate here the long time behavior of the system started in anything other 
than in a stationary state. In these cases, we must refer to the study of Gibbs 
states on half-spaces with particular boundary conditions but the main points 
must remain intact. 

We hope to include in a future publication the extensions mentioned above. 
In particular, all examples that appear in |]l9| can be systematically obtained 
using the one and same algorithm that will be explained below. We will briefly 
illustrate such a result (for a continuous time dynamics with a conservation law) 
at the end (Section 3.3). 

1.3 Notation and definitions. 

We restrict ourselves here to lattice spin systems. For lattice we take the regular 
d + 1-dimensional set d > 0. The reason for taking d+ 1 is that the extra 

dimension refers to the time-axis. The points of the lattice are denoted by 
x, y, . . . with x = («, n), n 6 Z, i £ HI 1 . We can read the time by the mapping 
t(x) = n if x = (i, n). The distance between two points x = (i, n), y — (J, m) £ 
7L d+1 is \x-y\ = max{|n-m|, \i-j\} with \i-j\ = max{|ii - ji\, . . . , \id-jd\} 
for the two sites i = (zi, . . . ,id),j — (ji, ■ ■ ■ ,jd) G Z d . The set of finite and 
non-empty subsets of X d+1 is denoted by S. For general elements of S we write 
A, A, . . .; they correspond to (finite) space-time regions. A c = \ A is the 

complement of A; |A| is the cardinality of A. 

A space-time configuration of our lattice spin system is denoted by er, rj, £, . . .. 
This is a mapping a : "E d+1 — > S with values u{x) E S in the single site state 
space S which is taken finite. Ising spins have S = {+1, — 1}. The set of all 
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configurations is fld+i = o . By o~e,E C Z we mean, depending on the 
situation, both the restriction of <r to £7 as well as a configuration on E, i.e. an 
element of S E . The configuration a^n^ is equal to cr on A and is equal to i] on 
A c . 

fid+i is equipped with the product topology and is a compact space. If we de- 
note by T the set of all subsets of 5*, then T\ = T A is the Borel sigma-algebra 
generated by the (<r(x),x G A). We write T = Tjd+i; (ft, J 7 ) is the measurable 
space of space-time configurations. 

Local functions on Qd+i are real- valued functions / which are .^-measurable 
for some A G S. The (finite) dependence set of such a local / is denoted by Df. 
A continuous function is every function on Qd+i which is the uniform limit of 
local functions. The uniform norm is denoted by ||/|| = sup CT 
Finally, configurations and functions on fld+i can be translated over t x ,x G 
7L d+1 : r x a(y) = a(y + x) 1 r x f{a) = ,f(T x <r). If clear from the context, we also 
write f x for r x f. 

We consider families of local one-to-one (invertible) transformations 7ta on 
S A where A will vary in some large enough subset of S (which will be specified 
later on). As maps on fld+i they have the properties that 

1. 

7r A (cr)(a;) = a(x),x G A c ; (1.5) 

2. 

7TA0 7TA = 1. (1.6) 

3. 

7TA ° T x = TTA+x (1-7) 

4. 

7r A (<T)(z) =Tr A ,{a){x) (1.8) 

for all x G A C A'. 

For every function / on fld+i, we write -K\f{a) = f{-K\{(j)). The (product 
over A of the) counting measure on S A is invariant under 7ta- Notice that the 
function A WA / = 7ta/ — / satisfies ttaA^/ = —^ K f. We give two interesting 
examples of such a transformation. 

Example 1.1 Take A = Km.l a rectangular shaped region centered at the origin 
with time- extension 2N + 1 and spatial volume (2L + l) d . The transformation 
7rA(c)(i, m) = a(j, —to), \ j\ < L, \m\ < N time-reverses the space-time configu- 
ration in the window An,l- 

Example 1.2 Take the Ising-case S = {+1, —1} and ir\(cr)(x) = —a(x),x G A 
corresponding to a spin-flip in A G <S. 

Probability measures on (Qd+i, T) arc denoted by fi, . . .. The correspond- 
ing random field is written as X = (X(x),x G Z d+1 ). The expectation of a 
function / is written as fj,(f ) = J f{a)^{da). As a priori measure we take the 
uniform product measure da with normalized counting measure as marginals, 
for which J f(a)da = 1/|5|' A ' X)o- A /( ct a) when / is J^-measurable. 
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We will be dealing with Gibbs states fi in what follows; /i is a Gibbs measure 
with respect to the Hamiltonian H at inverse temperature (3 (and always with 
respect to the counting measure as a priori measure) when for every A £ S and 
for each pair of configurations a a , tja € S A 



n[X(x) = a(x), x e A\X(x) = £(x),x e A c ] 
n[X(x) = r)(x),x e A\X(x) = £(x),x e A c ] 



exp[-0(H(a A U') ~ H{t,aU°))] 

(1-9) 

for /i— almost every £ € ^<2+i- The Hamiltonian H — Va is formally 
written as a sum of (interaction) potentials Ua(o~) = Ua(&a) with well-defined 
relative energies H(a)-H(r]) for {x € 1 d+1 : a(x) ^ r)(x)} £ S HJ^Asx \\ u a\\ < 
oo,x G Z d+1 . Other weaker conditions than uniform abs olute summability of 
the potential are possible. The essential Gibbs property is (|l.9| ) which identifies 
the existence of a well-defined relative energy governing the relative weights 



of configurations that locally differ. (l.£) is the infinite volume version of the 



equivalent statement for finite volume Gibbs states 

Ma^a^ac) = 1 - exp[-/3 ^2 u a{(^aVA^}, (1-10) 
Z A\ r l) AnA^tD 

with Zj[(j)) the normalizing factor (partition function with ij boundary condi- 
tions). 

Traditionally, Gibbs measures give the distribution of the microscopic degrees 
of freedom for a macroscopic system in thermodynamic equilibrium. The choice 
of the ensemble is determined by the experimental situation and is fixed by the 
choice of the relevant macro- variables. There is however no a priori reason to 
exclude nonequilibrium situations from the Gibbs formalism if considered as a 
procedure of statistical inference. Then the information concerning the nonequi- 
librium state (like obtained from measuring the currents) is incorporated in the 
ensemble. Moreover, as we will use in Section 3, one can in many cases ex- 
plicitly construct the Gibbs states governing the space-time distribution as the 
path-space measure for the dynamics. The fact that these examples concern 
stochastic dynamics should not be regarded as a return to the strongly chaotic 
regime but rather as the proper way to deal with incomplete knowledge about 
the microscopic configuration of a system composed of a huge number of locally 
interacting components. 

1.4 Main observation. 

We start with the simplest observation. The rest will follow as immediate gen- 
eralizations (with perhaps a slightly more complicated notation). 



Look at (1.9). This Gibbs property implies that the image measure of /i under 
a transformation that affects only the spins in A is absolutely continuous with 
respect to fi with the Boltzmann-Gibbs factor as Radon-Nikodym derivative. 
Putting it simpler, it is an immediate consequence of the Gibbs property that 
for all continuous functions / 

MK/) = KWa) (1-11) 



G 



with Wa = exp[— /^^AnA^^A^A — Ua)]- But now the road is straight: take 
/ = W 7 ^ -1 in ( 1.11 ) and compute 



H(W£) = ^(W^Wa). (1.12) 



From ( 1.11 ) this is equal to 

MttaT^- 1 ) = v(Wl x ) (1.13) 

where the last equality follows from 7ta(W / ^'~ 1 ) = W]^ x . Thus, it is immediate 
that Gibbs measures satisfy 

/i( e - A/3RA ) = M ( e - (1 - A)/5flA ), A € 1R (1.14) 

with relative energy Ra = t^aH — H corresponding to the transformation tta- 

Ra= [kaUa-Ua]- (1.15) 

AnA#0 

We now imagine the above for a sequence of volumes A growing to "E d+1 in 
a sufficiently regular manner (e.g. increasing cubes). Suppose now furthermore 
that n is a Gibbs measure for a translation-invariant interaction potential and 
that 

Ra{ct) = ^T x J(a) + Ma) (1-16) 

with J a bounded continuous function and ||/ia||/|A| — > as A becomes infinite. 
This will be made explicit later on. Then, the following limit exists: 

p(XJ\n) = - lim -L ln/x[exp(-/3A £ J x )] (1.17) 
' ' xeA 



with J x = t x J, and, from (1.14), it satisfies 

P (AJ|/x)=K(1-A)J|m)- (1-18) 
As a consequence, its Legendre transform 

ij(w\fj.) = sup[p(AJ|^) — Xw] (1-19) 

A 

satisfies 

ij(w\n) — ij(—w\ii) = —w. (1-20) 

It is not necessary (but it is possible) to employ the whole machinery of the 
theory of large deviations for Gibbs states to understand what this means: the 
probability law Pa(vj) for the random variable X^eA Jx(^)/\M as induced from 
the random field (X(x),x <E TL d+1 ) with distribution /i, behaves (for large A) as 

PaH ~ e- ij, WM)|A|_ ( 12 1) 



and the rate function ij(w\/j 1 ) satisfies ( 1.2C ). Comparing this with ( |l.4| ), we 
see we have obtained exactly the same structure as in the Gallavotti-Cohen 
fluctuation theorem with practically no effort. 



7 



1.5 Plan. 



We first present the fluctuation theorem in a Gibbsian context without too 
much reference to an underlying dynamics through which, possibly, the Gibbs 
states are obtained as space-time measures. Yet, to avoid misunderstanding, 
we repeat that we think of these Gibbs measures here as describing the steady 
states or symbolic dynamics for some spatially-extended non-equilibrium dy- 
namics. They are to be thought of as distributions for the space-time histories. 
Via standard thermodynamic relations, we give the relation between the action 
functional satisfying the large deviation principle (fluctuation theorem) and the 
relative entropy between the forward and the backward evolution. In particu- 
lar, in quadratic approximation, the Green-Kubo formula appears. Time enters 
explicitly in Section 3 where via the example of probabilistic cellular automata 
the general philosophy is illustrated. 

2 Fluctuation theorem for Gibbs states. 

In the present setup, we have no a priori reason to prefer one lattice direction 
over another and we fix the family of increasing cubes A ra of side length n G INo 
centered around the origin in which we are going to appl y the transformations 
7Ta„ = 7Tn having the properties described in Section [l.3] . For every A G S we 
write A n for the smallest cube A n (with n — n(A)) for which A C A n . 

2.1 Symmetry breaking potential. 

In what follows we simply set SI = fld+i- A potential U is a real- valued function 
on S x f2 such that V a G J 7 a (i- c - OIUV depending on the spins inside A) for each 
A G S (put U$ = 0). It describes the interaction between the spins in the region 
A. We consider a family of m + 1 interaction potentials (U%)a, a = 0, . . . , m. 
We assume translation-invariance, meaning that 

U2(v) = (2.22) 

for all A G S, x G X d+1 , r\ G SI. As usual we also take it that the total interaction 
of a finite region with the rest of the lattice is finite, i.e. we assume that the 
potential is uniformly absolutely summablc: 

£ira<oo. (2.23) 

(This assumption of uniformity is not strictly needed but it avoids irrelevant 
technicalities. Similarly, hard core interactions are also not excluded but extra 
care and assumptions would be needed.) Given the family of transformations 
7r n , we define the relative energies 

R a n = (*nU2-U%),a = 0,...,m. (2.24) 

We make a difference between the potential U° and the U a , a = 1, . . . , m from 
their behavior under the n n . We assume that U is invariant under the 7r„ in 
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the sense that Tv n U^ = U\ whenever n > n(A) implying that 

lli?°ll 

Umi^i = 0. (2.25) 

n \K n \ 

The reason for taking to > 1 is to allow for and to distinguish between possibly 
different mechanisms for breaking the symmetry of the reference interaction U . 

We define the current associated to the symmetry breaking interaction U a , a — 
1, . . . , to to be 

E ^xMn { A)U%-U%). (2.26) 



J" is a continuous function on and, from (2.22), J"(r]) = Jq(t x ti). The term 
'current' is suggestive for interpreting ( 2.26| ) as the real current at the space-time 
point x associated to some driving of a reference steady state v thereby breaking 
the time- reversal symmetry in the case of Example 1.1, see next section. We 
take v to be a Gibbs state with respect to the interaction U°, i.e. with formal 
Hamiltonian 

H° = Y,U%, (2.27) 

A 

(see ([l]^)) for which the ir— symmetry is unbroken: 

v o tt„ = v. (2.28) 



As a consequence, the currents (2.26) vanish identically in that state: 

i/(J£)=0,a = l,...,m. (2.29) 

The perturbed or driven state is denoted by \i. It is a translation-invariant 
Gibbs state at inverse temperature f3 with respect to the formal Hamiltonian 

m 

H = H° + ^E a H a , (2.30) 



where the H a are built (as in (2.27)) from the interaction potentials U a and 
where the E a are real numbers parameterizing the strength of a symmetry 
breaking or driving force. As before, in the definition of Gibbs states, we always 
take the normalized counting measure as a priori measure, see ( |l.9| ). 

2.2 Fluctuation theorem. 

Theorem 2.1 Suppose that /i is a translation-invariant Gibbs state for the 
translation-invariant potential (Ua = U\ + E a U2)A o,s in the preceding 

subsection. The limit 

p{X 7 E) = -lim-^ln^[e~ ,3 ^A„Er = i A = J °] (2.31) 
n |A„| 

exists and satisfies 

p(X, E) — p(2E — A, E) (2.32) 
/or every A = (Ai, . . . , A m ) and E = (E 1 , . . . , E m ) G M m . 



9 



Proof: The existence of the limit is a standard result of the Gibbs formalism, 
see e.g. 12, [|, p7| . As announced via (1.11) the main observation leading to 
( |2.32p is that 



M(7i"n/) = M(exp[-/3 ^2 i^nUA - U A )]f), 



(2.33) 



simply because /i is a Gibbs state for the potential (Ua) at inverse tempera- 
ture /?. Therefore, taking numbers /i Q , a = 1, . . . , m and / = cxp[/3 X)™=i(l — 
ft. a )-E Q i?"] in that formula, 



M (exph/?i?° - p V /i a £ Q i^]) = 



m 



M (exp[-/3i?« - /3 £ £F*J£] exp[/3 £(1 - K)E a R«}) 



a=l 



Now, 



where both 



and 



li(exp[-pJ2(l-h a )E a R%}). 

R n — 2 E J x - h 



xeA„ 



Yj TA\{*n{A)U A *-U%) 



E ^ LI 

xeA n ABx,AnA^0 ' 1 



E 

AnA„,^nA= ^0 



(^ - t^) 



(2.34) 



(2.35) 



(2.36) 



(2.37) 



are small of order o(|A n |) because of (|2.23 ): ||Jj||/|A„| — > as n goes to infinity, 
i = 1, 2. Upon inserting ( |2.35| ) into ( |2.34| ) and taking /i Q = X a /2E a (for £ Q ^ 
0), we get 

1 ,. MexpRJE^E^iA^]) 



|A„| 1 ln M(exp[-/3E, eA „ E"=i(2^ - A«)J«]) 1 
going to zero as n f oo. This is exactly what was needed. ■ 



(2.38) 



Remark 1: Gibbs states satisfy a large devi ation pri ncipl e, see e .g. J17J and 
[|J for additional references. As a result, ( 2.32 ) implies ( 1.21 )-( 1.2C ). We do not 
add a more precise formulation here. 

Remark 2: Related to this, as is clear from the proof, the essential property 
is that the functionals {log : A £ 5} satisfy a large deviation principle 

under ji. We speak about the (somewhat more restricted) Gibbs property be- 
cause, in all cases we have in mind, the large deviations arise from Gibbsianness 
of the random field. 

Remark 3: The theorem above provides a local version of the fluctuation 
theorem since the measure \x lives on a much larger (in fact, infinite ) vol ume 
than the size of the observation window A n . The relations ( 1.14 ) and ( 2.34 ) are 
identities exactly verified for the finite volumes A n . This is similar to the local 
fluctuation theorem of S. Notice also that the limit p(A, E) exists and remains 
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unchanged if instead of taking the sequence of cubes A„ we take volumes A 
growing to in the van Hove sense, see e.g. |l^, |], ^7|. This will be 



exploited in the next section (Theorem 3.1) to separate time from the spatial 
volume. 

Remark 4: The fluctuation theorem is formulated here (and elsewhere) on a 
volume-scale, anticipating large deviations which are exponentially small in the 



volume, see (1.21). This is certainly the typical behavior at high temperatures. 
However, the same reasoning of the proof above remains equally valid for other 
— less disordered — regimes where the large deviations may happen on another 
scale. As an example, suppose that 

a(X,E) = -lim^m M [e~"^A„Er = i A ° J °l. (2.39) 

Then, remembering that A n ~ n d+1 , it also satisfies 

a(X, E) = a(2E — A, E). (2.40) 

Such a scaling is applied in the study of large deviations in the phase coex- 
istence regime where the probability of a droplet of the wrong phase is only 
exponentially small in the surface of that droplet. 

2.3 Thermodynamic relation. 

As mentioned in the introduction, the original context of the fluctuation theorem 
concerned the large deviations in the entropy production rate of a dynamical 
system. Since we have not specified any dynamics here, we must postpone a 
related discussion to the next section. Yet, we can compare with the thermo- 
dynamic potentials. 

To start define the energy function 

A30 1 1 

and its translations & x (U)(i]) — Qo(U)(t x 7]). We define the free energy density 
for the interaction U as 

P((7)^lim-Lln ex PM E ^Wl). (2-42) 
This coincides with 

P(U) =Hm-^ In Zljji) (2.43) 
n |A n | 

of (1.10) for all boundary conditions r\. 

Finally, the entropy density of a translation-invariant probability measure y, 

is 

s(/i)E-lto— V /i„[cr] In // n [cr] > (2.44) 

" |An| CT GQa„ 

where fx n [a] is the probability for the measure /i to find the configuration a in the 
box A n (and In = 0) . The relative entropy density between two translation- 
invariant probability measures /j, and p (with p n (<r) = implying p, n (a) = 0) 
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IS 



s(p\p) = lim 



— y 



/X„ <7 In — — r > 0. 



(2.45) 



If yLt is a translation-invariant Gibbs measure (at inverse temperature (3) for the 
interaction U, then 

P(U) = s(n) - 0ii(* o (U)). (2.46) 

For a given interaction (Ua) we also like to have around the free energy func- 
tional F(U, p) defined for translation-invariant probability measures p by 



F(U,p) = s(p)-/3p($ (U)). 



(2.47) 



We have, besides F(U,p) = P{U) for the Gibbs measures p with respect to U, 
see Q2.46D , that 

P(U)>F(U,p) (2.48) 

for all translation-invariant probability measures p which are not Gibbs measures 
for U at inverse temperature (3 (Gibbs' variational principle). 
The 7T— transformed interaction potential nil is defined via 



ttUa = ^n(A) Ua 



(2.49) 



and the tt— transformed measure np is obtained by its expectations for all local 
functions /: 

Mf)=»°*n(f) (2-50) 

for n = n(f) so that Df C A„. Clearl y, P (ttU) = P(U) by the assumed 7r— 
invariance of the counting measure, see (|l.3| ). (This also f ollows from observing 
that -P(irU) + P(U) = p(2E, E) = p(0, E) = by (^32|) and (|^).) For the 
same reason, s(np) = s(p) and if fj, is a Gibbs measure for U, then np is a Gibbs 
measure for ttII (and vice versa). (To avoid trivialities, it is understood that 
the interaction nil is not physically equivalent with U as long as some E a ^ 0.) 

We next show that the averaged current (whose fluctuations are investigated 
in Theorem 2A ) is always (strictly) positive as it equals a relative entropy den- 
sity. To link it also to a free energy production we must require that the free 
energy PiU + t(nU — Uj) is differentiable with respect to t at t = 0. For this 
(see e.g. p~2[), it suffices e.g. that 



"£\A\\\U° A \\,J2E a 52\A\\\U2\ 



< 1. 



A30 



A30 



(2.51) 



Proposition 2.1 For the Gibbs measure fi ^ irfi of Theorem 2.1 

m 

s(irp\p) = s(p\irp) = 2/3 E a p(J«) > 



(2.52) 



and, under the assumption (2.51), is also given via 



1 d 



£ E a p(J«) = ~^g- t P(U + t(7:U - U))(t = 0). 



(2.53) 
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Proof: The positivity follows from the variational principle: 



sQm) - M®o(U)) = P(U) > F(U, 7T/i) = s(ji) - /3tt M ($ ([/)). (2.54) 



As is well known the relative entropy ( |2.45 ) can be rewritten as a difference of 



free energies: s(7r/i|/x) = P(U) — F(U,tt[/,). We can now use that 

/3/x($ (ttC/) - $o(CO) = -^(t 7 + - U))^ = °) ( 2 - 55 ) 
is exactly equal to 2/3 E a n(Jg), as required.B 



Remark 1: The positivity of ( 2.52 ) should be compared with (1.3). The 
positivity of the entropy production is discussed in |p3| , [2^| . The positivity 
of ( 2.52| ) just follows here from the Gibbs' variational principle: with s n 



E a J2 X £A n Jx> ^ or almost every a, s n (a)/\A n \ — > s(^\tt/i)/2P > where 
the almost sure convergence assumes that [i is a phase. That s{p\~K\i) has some- 
thing to do with entropy production will become clear in the next section when 
a dynamics and the time-reversal operation is considered. 

Remark 2: Thinking about s{ji\n\x) as entropy production, ( [2.52 ) gives the 



usual bilinear expression in terms of thermodynamic fluxes and forces. Re- 



member that the dependence of p(X,E) on E in (2.31) comes from the state 
/i. The E a correspond to field strengths or amplitudes producing energy- or 
particle flow. Of course, on the formal level above, the distinction must remain 
arbitrary and one can of course include the E a in the potentials U%. 

2.4 Green-Kubo formula. 

It has been observed in other places, (l6[ [H], f7|, that the fluctuation theorem 
quite directly gives rise to various familiar formulae of linear response. We will 
not pursue this matter here very far except for repeating the simplest deriva- 
tions. 

Assuming smoothness of the free energy in the external fields, we differentiate 
( p. 32 ) with respect to E 1 and A Q , a, 7 = 1, . . . , m at E = A = 0: 

d d d d d d 

K0,0) = -__p(0,0) - 2 — — p(0,0). (2.56) 



din d\a y ' ' dE-ydXa " ' d\-yd\ a 
On the other hand, 



JLp(0,E)=(3n(J«) (2.57) 



while 



Conclusion, 



1 '%(0,0) = -/3 2 ]>>(«)• (2.58) 



d 



dE~ ( 



^){E = 0) = /?^^o Q 4 7 ), (2.59) 



and the change in relative entropy s(/i|7r/i) (sec (|2.52 )) from Proposition 2A is 
in quadratic approximation for small E given by 

S (/iM = 2/3 2 ]T E a W »( J oJ2)- (2-60) 

a, 7 x 
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Equation ( 2.59 ) is a standard Green-Kubo relation while ( |2.60| ) expresses the rel- 



ative entropy density s(//|7r/x) (or change in free energy) in terms of the current- 
current correlations (with the obvious analogues of Onsager symmetries). In 
conclusion, we have identified a (model-dependent) continuous function 

S(a)^Y, Eaj o(°) ( 2 - 61 ) 

a. 

with ttS = —S)fi(S) > 0,1/(5') = and symmetric response matrix 

^ { ^)(E = 0) = /?$>(«)• (2-62) 

X 

Symmetries in higher order terms can be obtained by taking higher derivatives 



of the generating formula (2.32) 



The notation S should not be read as a time-derivative (change of entropy in 
time). More appropriate will be to regard /x(5)/2 as the limit (Sf — Si)/T 
as time T goes to infinity of the total change of entropy Sf — Si in a reser- 
voir during the noncquilibrium process. The reservoir is initially in equilibrium 
with thermodynamic entropy Si and after absorbing the heat dissipated by the 
noncquilibrium process it reaches a new equilibrium with entropy Sf. We will 
come back to this once time has been explicitly introduced (in Section 3). 



3 Fluctuation theorem for PCA. 

PCA (short for probabilistic cellular automata) are discrete time parallel up- 
dating stochastic dynamics for lattice spin systems. They are used in many 
contexts but we see them here as interesting examples of non-equilibrium dy- 
namics. We refer to for details and examples and we restrict ourselves 
here to the essentials we need. We work with time-homogeneous translation- 
invariant nearest-neighbor PCA which are specified by giving the single-site 
transition probabilities 

< Pi, n (a\a) = Pi(a\a(J, n - 1), \j - i\ < 1) < 1, a G S, a G fl d +i- (3.63) 

This defines a Markov process (A n )„ =0 ,i... on for which for all finite V C Z d , 

Prob [JT n (i) = Oi.Vt G V\X n -i] = IJpi(ai|.X" n _i(j),l*-j| < l),a< G S 

iev 

(3.64) 

with some given initial configuration Xq — £ G Qd- Notice that we have kept 
the notation a for a general configuration on the space-time lattice. Remember 
that x = (i,n) G 7L d+1 stands for a space-time point with time-coordinate n at 
site i e 1 d . 

The 7Ta are restricted to time-reversal transformations and the volumes A are 
to grow first in the time-direction (for a fixed spatial window) . 

3.1 Steady state fluctuation theorem. 

If we take a translation-invariant stationary state p of a PCA as above, then 
its Markov extension defines a translation-invariant Gibbs measure fi for the 
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(formal) Hamiltonian 

H{v) = - lnpj, n (o~(i, n) \a(-, n - 1)). (3.65) 



We refer to |L3j 18 for a precise formulation, p describes the distribution 
of the space-time configurations in the steady state and its restriction to any 
spatial layer is equal to the stationary state p we started from. To characterize 
p, one must study the projection of /i to a layer (see for a variational 
characterization of such a projection). 

Since p is Gibbsian we can try applying the theory of the previous section. Most 
interesting is to consider a sequence of rectangular boxes A^ jv = {x = (i, n) € 
•£d+i = "£ d x "Z : \i\ < L,\n\ < N}. The idea is that we wish to keep the spatial 
size L much smaller than the time-extension N » L. As transformation we 
take n\ L N = -kl.n corresponding to a time-reversal: 

T^L,No{i,n) = a(i, —n), \n\ < N, \i\ < L (3.66) 

and iTL^o{i,n) — a(i,n) whenever (i,n) ^ A^jv- 
Define the current 

Ji,n{v) = lnpi(a(i,n)\a(-,n - 1)) - \npi(a(i,n - l)|<r(-,n)). (3.67) 

Notice that in contrast with the previous section, we do not specify here the 
unperturbed state (but one can always take some homogeneous product mea- 
sure) and we take m = 1 = 2E for simplicity. J^ n is a local function and it is 



the space-time translate of Jq. In the same way as in ( 2.24 ), we define 



R L , N (a) = H(w L , N a) - H(a). (3.68) 



Starting from ( 3.6 5| ) Rl.n can be written out as a finite sum but most important 
is that 

N-l 

Rl,n(<j)= J2 Ji,n(<r)+ G L,N(<r), (3-69) 

n=-N+l \i\<L-l 

where 

\\G l ,n\\ < c(2A^ + 1)(2L + l)^ 1 + c'{2L + l) d < c{d)NL d -\ (3.70) 

with a constant c{d) depending on the dimension d and on the transition proba- 
bilities ( 3.63| ). We arc therefore in a position to repeat the fluctuation Theorem 



2.1 in that context. 



Theorem 3.1 Take L = L{N) < N growing to infinity as N f oo. The limit 
e(A) = -lim — - — f ln/z(exp[-A J in ]) (3.71) 

N \ A L,N\ cA 

exists for all real A and 

e(A)=e(l-A). (3.72) 

Moreover, for fixed L, 

ei,jv(A) = -j= ln/i(exp[-A J i)tl ]) (3.73) 

i€Al-i,«-i 
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(which, generally, is of order L d ) satisfies 

\e L}N (X) - e L , N (l - A) | KciWL*- 1 

uniformly in N | oo. 



(3.74) 



Proof: The proof is a copy of the proof of Theorem 2.1. As before, we have 



automatically, from the Gibbs property (as in (1.14)), that 



fj,(exp[-XRL,N]) = /u(exp[-(l - X)R l ,n})- 



(3.75) 



We now substitute (3.69) and use the estimate (p.7C|) to perform the limits 



Remark 1: One may wonder about the existence of the limit e^(A) = limjv ei.jv(A) 
for fixed L. This is certainly expected when the steady-state p is a high temper- 
ature Gibbs state. In that case, the limit limiei(A)/L d = lim^e^l — X)/L d 
satisfies (3.72). 

Remark 2: Some quite similar results were discussed already in There how- 
ever the dynamics was deterministic (weakly coupled strongly chaotic maps). 
There again, the methods of ||, [ll| can reduce the problem to a higher 
dimensional symbolic dynamics and the methods of the previous section are 
ready for use. 



3.2 Entropy production. 

The measure p gives the probability distribution of the sp ace-t ime histories in 
a steady-state. It is therefore natural to consider s(p) (see ( 2.44 )) as its specific 
entropy rate (i.e, entropy per unit volume and per unit time). In terms of the 
stationary state p we have (see JT3I ) that 



(3.76) 



On the other hand, the fr ee en ergy density vanishes identica lly fo r PCA (because 
of the normalization in ( 3.65 ), see (l^, [is) ) , so that, from ( 2.54 ), 



P(U) = 0, P(U) - F(U, nfi) = -s(fi) + PMMU))- 

Hence, still in the notation of the previous section, whenever P(U) 
is verified for PCA), 

- s{p\TT^) = S (/i) - f3TTfJ,(<f> (U)). 



(3.77) 
(which 

(3.78) 



(This formula is not correct when we replace in it /x by 7r/z.) That is interesting 
because we found that now s(^|-7r/i) > is minus the specific entropy rate s(/i) 
modulo a term which is linear in \x. Writing this out in our present notation, 
this is nothing else than 

- fi(J ) = -p(^2po(a\o-(-,-l))lnp (a\a(-,-l)) - fi(- lnp (a(0)\a(-, 1)). 

a£S 

(3.79) 

The first term to the right is the specific entropy rate ( 3.76 ) (always positive) 
and the second term (linear in p) subtracts from this exactly so much that the 
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net-result to the left vanishes in the case of time-reversal symmetry (detailed 



balance). Of course, as in Proposition 2.1 we have an equality between the aver- 



aged current in the steady state p and the relative entropy s(p\Trp) (remember 
that we took m = 1 = 22?!). We can therefore conclude that indeed p(Jo) or 
s(fi\Ttfj,) must be regarded as the (positive) entropy production by our dynamics. 
The current associated to the breaking of time-reversal symmetry gives rise to 
nothing else than the local (in space-t ime ) ent rop y production whose fluctua- 



tions we have investigated in Theorems 2.1 and 3.1. The points made in Section 



2.4 related to the Green-Kubo formula remain unaltered and we do not repeat 
them here. 

Yet, to obtain a physically inspiring picture, we should connect the above anal- 
ysis to measurable quantities. The (second part of the) second law of thermody- 
namics connects the thermodynamic entropy of an initial and final equilibrium 
state after some thermodynamically irreversible process has taken place. In an 
adiabatic non-quasi-stationary process the entropy can only increase: Sf > Si. 
If we now were to rerun the process in the opposite direction, simply by (ther- 
modynamically) inverting all the currents (by changing the sign of all gradients 
of the intensive variables), again the entropy would increase and by the same 
amount as before (s(p) = s(irp)) and we would reach a new equilibrium with 
entropy equal to Si + 2{Sf — Si). While we lack at this point a more formal 
understanding, we believe that our entropy production exactly measures that 
difference: [Sf - Si] - [Si - S f ] = 2(S f - Si) = s(mKm) > 0. More generally 
and depending on the physical realization of the process, these considerations 
must apply to the relevant thermodynamic potential and 'entropy production' 
must for example be replaced by 'work done' or 'free energy production.' 
We will further illustrate this by an example in the following subsection but it is 
interesting to remark already that s{p[irp) reproduces, via the formal analogies 
on the level of the variational principle (both for Gibbs and for SRB states) , the 
entropy production in the context of the theory o f dy namical systems. There 
we have that the entropy production is given by (^) with p(S) equal to the 
sum of the positive Lyapunov exponents with respect to minus the sum of 
positive Lyapunov exponents with respect to (p. If p is singular with respect to 
d£ and has no vanishing Lyapunov exponent, then p(S) > 0, see j23j. In our 
case, s(mM = /3ttp($o{U)) - f3p($ a (U)) = P(U) - F(U, irp) > 0. 

3.3 Illustration. 



We take here a closer look at the current (3.67) for Markov chains. The spatial 



degree of freedom i G if has now disappeared and we must study 

J„(ct) = In p(a(n) \ a(n - 1)) - lnp(a(n - l)\a(n)) (3.80) 

for a 6 fl\ and transition probabilities 

Prob [X„ = a|X n _! = b] = p(a\b), a,be S (3.81) 

for the stationary S- valued Markov chain X n . The steady state p is now a 
homogeneous one-dimensional Gibbs measure and its single-time restriction is 
the stationary measure p on S : J2bP( a \b)p(b) = p{ a )i a <E S. 
The steady state expectation of the current ( |3.8C| ) is 



(j) = EpwEp( a i 6 )[ ln ^ a i 6 )- ln ^ 6 i a )]- ( 3 - 82 ) 
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Now use that the transition probabilities q(-\-) for the reversed chain (Y n = 
X— n ) n (with distribution irp but with the same stationary measure p) are given 

by 

( p(a) 



q(a\b) = Prob [X n = a\X. 



n+1 



b]=p(b\a) 



P(b) 



(3.83) 



Since J2 b P( b )Y,Ma\ b ) ln P( b ) = E&pO) ln P<» = Eb P( b ) J2 a P( a \ b ) ln P(«)> we 
can substitute ( |3.83[ ) into (3.82) (g(a|&) for p(6|a)) with no extra cost and we 
obtain 

p(J ) = p(S(p\q)) (3.84) 



where 



S(p|g) = X>(a|01*^>O. 



(3.85) 



is the relative entropy between the forward and the backward transition proba- 
bilities. ( [3.85 ) is zero only if the Markov chain is time-reversible (in which case 
p = 7r/i). Then, (3.83) for q(a\b) — p(a\b) becomes the detailed balance condi- 
tion. Relation (3.84) is nothing but (2.52) specified to the context of Markov 
chains. 

A second less trivial and physically interesting illustration can be taken from 
a model of hopping conductivity. It is a bulk driven diffusive lattice gas where 
charged particles, subject to an on-site exclusion, hop on a ring in the presence 
of an electric field. The configuration space is l^i = {0,1} with = or 
1 depending on whether the site i G T is empty or occupied. We take for T 
the set {1, ...,£} with periodic boundary conditions. To each bond (i, i + 1) 
in the ring and independently of all the rest there is associated a Poisson clock 
(with rate 1). If the clock rings and — 1, £(i + 1) = then the particle at i 
jumps to i + 1 with probability p. If on the other hand, £(i) = 0,£(i + 1) = 1 
the particle jumps to i with probability q. Therefore, the 'probability per unit 
time' to make the transition from £ to (in which the occupations of i and 

i + 1 are interchanged) is given by the exchange rate 



c(i, i + 1, = p£(i)(l - £(i + 1)) + qt(i + 1)(1 - £(*)). 



(3.86) 



and should be thought of as a continuous time analogue of ( 3.63| ). It is natural 
to call E = lnp/q the electric field. This model is called the asymmetric simple 
exclusion process and it is also considered in [^9|. Strictly speaking, it is not a 
PCA but a continuous time process with sequential updating. However, since 
it is a jump process, the change with respect to the PCA of above just amounts 
to randomizing the time between successive transitions. 

Each uniform product measure p is time-invariant for this process and we con- 
sider the steady state p starting in this invariant state. If we now consider a 
realization a of the process in which at a certain time, when the configuration 
is £ € fii, a particle hops from site i to i + 1, then the time-reversed trajectory 
shows a particle jumping from i + 1 to i. The contribution of this event to the 
entropy production is therefore 

Inc(*,t+l,0-Inc(i > i+l J ^ i+1 ) = £;K(<)(l-e(*+l))-€(<+l)(l-e(*))]- (3-87) 



This formula is the continuous time analogue of ( |3.80 ) or ( 3.67 ) (but we do not 
take E = 1/2 here) with £ the configuration right before the jump and £*>' +1 
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the configuration right after the jump in the trajectory a. Of course, this jump 
in a itself happens with a rate c(i, i + 1, £). We see therefore that the derivative 



of (3.87) with respect to E has expectation 



H(j itt ) = p(c(i, i + - S(* + 1)) - W + - £(*))]) = (P - " «) 

(3.88) 



for u = p{£{i)) the density. ( p.88|) is indeed the current as it appears in the 
hydrodynamic equation, here the Burgers equation, through which a d ensity 



profile evolves. The fluctuations of the particle current satisf y (2.3 2j) or ( 3.72 ) 



(with E = 1/2), see also [1S|1 . The entropy production (as in (|3.84| )- (|3.85| )) is 



^(mM = P (c(i, i + 1, o ln c( ^+t,^M+i) ) = ~ 9)m(1 " u) (3 - 89) 

which is the field times the current and is left invariant by changing E into 
—E. If, to be specific, we take p — 1/(1 + e~ E ) = 1 — q, then, in quadratic 
approximation, 

-s(p,\Trp.) = u(l - u)E 2 (3.90) 

which is the dissipated heat through a conductor in an electric field E with 
Ohmic conductivity u(l - u) = p{J%){E = 0) = p(c(0, 1, £)[£(0)(1 - f(l)) - 
£(1)(1 — £(0))] 2 ) given by the variance of the current. This model (together 
with the models discussed in Jj"9[ ) illustrates that the methods exposed in the 
present paper are not restricted to just PCA. We have restricted us here to a 
somewhat informal treatment of the aspects concerning the entropy production 
in the model as it will be included in a future publication dealing with the local 



fluctuation theorem, 21 . 



4 Concluding remark. 

It does not seem unreasonable that Gibbs' variational principle determining 
the conditions of equilibrium can be generalized to certain nonequilibrium con- 
ditions. In this note we have shown that describing the steady state via the 
standard methods of the Gibbs formalism leads directly to the fluctuation theo- 
rem. This is true close or far from equilibrium because it follows quite generally 
from the defining Gibbs property itself. From this 'Gibbsian' point of view, ap- 
plying the local fluctuation theorem to various specific models is to add specific 
observable consequences to the studies of E.T. Jaynes, p3. 
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